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Experimental implementations of quantum information processing have now reached a level of 
sophistication where quantum process tomography is impractical. The number of experimental set- 
tings as well as the computational cost of the data post-processing now translates to days of effort 
to characterize even experiments with as few as 8 qubits. Recently a more practical approach to de- 
termine the fidelity of an experimental quantum process has been proposed, where the experimental 
data is compared directly to an ideal process using Monte Carlo sampling. Here we present an ex- 
perimental implementation of this scheme in a circuit quantum electrodynamics setup to determine 
the fidelity of two qubit gates, such as the CPHASE and the CNOT gate, and three qubit gates, such 
as the Toffoli gate and two sequential CPHASE gates. 



Quantum process tomography [1] is a widely used 
method to obtain a complete description of experimental 
implementations of gates or algorithms. With the on- 
going experimental progress and growth in system size, 
quantum process tomography is already impractical and 
will soon become infeasible in state-of-the-art experi- 
ments, since the number of experimental settings as well 
as the computational cost of the post-processing increases 
exponentially with the number of qubits. Even the most 
recent tomography algorithms would need days of data 
post-processing in order to yield a process tomography 
estimate for as few as 8 qubits [2]. 

Experimentally, the determination of the process ma- 
trix x for an n-qubit process involves the preparation of 
the qubits in 4™ different product states, where each qubit 
is prepared in one of the states |0), |0) + |1), |0) — or 
|1). The quantum process under consideration is then al- 
lowed to act on each of these n-qubit initial states. Then 
the expectation values of 4™ linearly independent oper- 
ations, typically chosen as all possible tensor products 
of Pauli operators, are measured. Overall, this results 
in 4 2n distinct expectation values to be measured. The 
process matrix Xcxp can then be obtained by linear inver- 
sion. However, experimental imperfections and statisti- 
cal fluctuations lead to unphysical results like a process 
matrix x C x P with negative eigenvalues or a trace unequal 
to one. To get a physical process matrix, one usually 
applies maximum-likelihood procedures [3] which search 
for a physical process matrix xml that is most likely to 
have been implemented given the experimental observa- 
tions. An estimate of the process fidelity [4, 5] between 
the implemented process and the ideal process is then 
calculated as 

^(Xideal, Xml) = tr [XidcalXMlJ , (1) 

which in turn is related to the average output state fi- 
delity F by F = (dF + \)/{d + 1) where d is the dimen- 
sion of the Hilbert space used to describe the states of 
the system [6] . 



While quantum process tomography is useful to fully 
characterize a process, it has two major drawbacks for 
verifying processes by calculating their fidelity. First, it 
is inefficient, especially for a large number of qubits, since 
more information is acquired than is needed to calculate 
the process fidelity. Second, maximum-likelihood proce- 
dures can lead to estimates that imply greater confidence 
than can be supported from the data [7]. Therefore, it 
is difficult to assign an error to the obtained fidelities. 
Instead, Monte Carlo process certification [8, 9] is an 
efficient approach for the determination of the fidelity 
of a quantum process. It does not rely on maximum- 
likelihood procedures and the number of measurements 
needed to obtain some desired accuracy depends only 
polynomially rather than exponentially on said accuracy, 
and not on the size of the system. 

Here we present the implementation of Monte Carlo 
process certification on two- and three-qubit gates in 
a circuit QED system [10-12] with three transmon 
qubits [13] coupled to a superconducting waveguide res- 
onator. We give a detailed description of the protocol 
implemented with our setup and analyze the errors of 
the protocol. The obtained fidelities are then compared 
to fidelities obtained by quantum process tomography. 

Monte Carlo process certification relies on the fact that 
an n-qubit process £ can also be described by a 2n-qubit 
density matrix p£ = (1 (g) £)(\(f))(<p\), known as the Choi 
matrix [14, 15], with \(f>) = ^ Yn=i N) ® V) and d = 2" 
the dimension of the state Hilbert space. The fidelity of 
the experimentally realized process Xexp to the respective 
ideal unitary process Xideai is identical to the fidelity of 
the corresponding Choi matrix 

fXXideabXexp) = F(p £ idcal , p fexp ) = tr [p£ ideal /3f exp ] , (2) 

where the last equality holds because the ideal process is 
unitary and thus the corresponding Choi matrix is pure. 
This expression can be re-written as 

n^ea^pHEP^A (3) 
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where p l = tr P£ idea iP and cr, = tr /3 fexp P . Here, P 
is an orthonormal Hermitian operator basis chosen as the 
4™ tensor products of the Pauli matrices and the identity 
and the sum (3) is taken over only the i with pi ^ 0. 
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The distribution Pr(i) = ^ reflects the relevance of the 
expectation of an operator P, for the fidelity calculation. 
By sampling randomly N indices ii,i2, ■ ■ ■ ijv following 
the distribution Pr(i) one obtains an estimation of the 
fidelity J2k=i 7r~ wrtn an uncertainty that decreases 
as /-= . 

The straightforward implementation of Monte Carlo 
process certification as described above is rather imprac- 
tical, since the measurement of a state ps, representing 
the Choi matrix of the process £, would require 2n qubits 
for an n-qubit gate, as well as perfect storage of the n 
ancillary qubits. 

A more experimentally relevant approach is to prepare 
and measure n-qubit states only [8, 9]. The key idea is 
that the effect of the measurement of the first half of the 
state \(j)), on which no gate is applied, corresponds to a 
projection of the second half of the state \<j>) onto complex 
conjugates (in the computational basis) of cigenstates of 
the first half of the measurement operator. The measure- 
ment of ps with randomly chosen operators A®B, where 
A, B are tensor products of n Pauli matrices or identities, 
can be expressed as 



tr 



(A®B)ps]= tr[(i®B)(l®5)(|0X0l) 



-^Bitr^tkM] • (4) 

i=l 

Here |a») is the complex conjugate of the i th eigenstate of 
the operator A with eigenvalue a,. This final expression 
corresponds to the action of the process £ on the state 
\di) followed by a measurement of the observable B. The 
results for different input eigenstates are then summed 

up to obtain an estimate of tr (A <g) B)p£ . 

The implementation of the Monte Carlo process cer- 
tification protocol was performed in a superconducting 
quantum processor consisting of three transmon qubits 
coupled to a coplanar waveguide resonator. The sample 
used is the same as in Refs. [16, 17]. 

Our 3-qubit system is small enough that we can mea- 
sure all relevant operators and do not need to resort to 
random sampling. This still allows for a significant sav- 
ing in the number of measurements because many of the 
measurements required to perform process tomography 
are irrelevant for the fidelity estimate. In other words, 
we measure all operators that have a non-zero expecta- 
tion value for the ideal gate, and calculate the accordingly 
weighted average to compute the gate fidelity. 

The protocol requires the preparation of qubits in 
cigenstates of Pauli operators A and the measurement 



of Pauli operators B. The preparation of the qubit input 
states is straightforward by using amplitude and phase 
controlled coherent microwave pulses applied to the indi- 
vidual charge control lines. In our setup, the implemen- 
tation of the measurement using joint dispersive read- 
out [18] of all qubits is a more complex procedure. The 
measurement operator is 

M= a»i,...,i„l*lX i l|®l i 2X i 2|®---®Kn)(in| I 

ii,...,»„e{o,i} 

(5) 

where |0), |1) are the computational basis states. The co- 
efficients cti lt ...j n are obtained from measurements of the 
resonator transmission amplitude for each computational 
basis state [18-20]. M expressed in terms of individual 
qubit identity and a z Pauli operators is 



M = 



E 



>3n, 



(6) 



ji,...,j„e{i,CT z } 



with coefficients calculated as combinations of 

the £*»!,...,»„. 

In general the measurement operator has 2™ different 
elements. However, in Monte Carlo process certification 
for each input state the expectation value of only one spe- 
cific element is needed. This element can be obtained by 
adding measurement outcomes with different signs of a z 
operators of different qubits, realized by 7r pulses applied 
to the corresponding qubits just before the measurement. 
Since the first element 1 <g> • • • <£> 1 has always an expec- 
tation value of one, one needs to perform 2™ _1 different 
measurement to extract a single operator B. 

As an example, the joint readout procedure of the oper- 
ator <j y (g> u x for two qubits is presented in the following. 
The joint readout operator is M = a O o|0)(0| ® |0)(0| + 
ooi|OXO| ® |1)(1| + oiojlXll ® |0)(0| + an|l)(l| ® |1)(1|, 
which is equivalent to M = (3oot®t+f3 it®<7 z +f3io<r z ® 

1 + Pu&z (£> a z . The prefactors 0ij are determined from 
measurements of the ay as described above. 

To measure the given combination of Pauli operators, 
we rotate accordingly the measurement basis of the indi- 
vidual qubits. For the example above, we apply a — ir/2 
rotation around the a;- axis to the first qubit and a n/2 
rotation around the j/-axis to the second qubit. The re- 
sulting measurement operator is M — /3 ol ® 1 + A)il ® 

To extract only the last term in the measurement op- 
erator, a second measurement with an additional ir pulse 
on both qubits is performed. This results in a measure- 
ment operator with two minus signs: M — /3ool ® 1 — 
/Soil ® &x — Pw&y 1 + PnCTy ® a x . Adding the mea- 
surement outcomes of the two experiments (for the same 
input state) gives the expectation value for the operator 

2 (/3ool ® 1 + fiu&y ® Vx)- Since the expectation value 
for 1 (g> 1 is always equal to 1 and /? o and /?n are known, 
the expectation value of a y (g) a x can be extracted in this 
way. 
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FIG. 1. Measured expectation values of all the relevant observables of the (a) CNOT gate and (b) Toffoli gate Choi matrices. 
The thin border shows the ideal expected values, the colored squares are the estimated values. The (00, 00) and (000, 000) 
entries are the expectations of the identity, so they have sizes corresponding to absolute value 1 and the area of the other 
squares arc adjusted proportionally. The column label corresponds to the most-significant digits of the binary expansion of the 
index of the observable, while the row label corresponds to the least significant digits (see supplementary information). 



Hence, it is possible in our experiments to extract 
any expectation value of two-qubit Pauli operators from 
two measurements or three-qubit Pauli operators from 
four measurements, using the corresponding single qubit 
rotations. Having found the expectation values <jj = 
tr PEc Xp Pi ; the fidelity can be directly calculated ac- 
cording to Eq. (3). 

According to Eq. (4), a measurement of one of the 
expectation values <7j consists of averaging measurement 
outcomes over different input states. To achieve this, 
one can also perform a Monte Carlo sampling of which 
eigenvectors to prepare as input states. The weighting 
factor for the sampling is given by the absolute value of 
the eigenvalue. Since in our experiments the system size 
is small but a high accuracy is desired, we measured all 
eigenstates. 

The protocol has been tested on a 2-qubit CNOT and 
CPHASE gate [21, 22], on a 3-qubit Toffoli gate [17, 23], 
and on the sequential application of two CPHASE gates on 
three qubits. The CNOT and the CPHASE gates are par- 
ticularly interesting for Monte Carlo process certification, 
since they map elements of the Pauli group to other ele- 
ments of the Pauli group. Such gates are Clifford opera- 
tions and their Choi matrices are stabilizer states [24, 25] 
for which the number of relevant Pauli operators is min- 
imal with uniform relevance distribution. For any stabi- 
lizer state ps there is a subgroup S of the Pauli group 
with elements Si such that the pure state correspond- 
ing to P£ idcal is an eigenvector of all Si with eigenvalue 
+1. The expectation value of each operator in this sta- 
bilizer group is +1. Therefore, the relevance distribution 
Pr(i) = 1/4™ is uniform for alH € {1, . . . , 4™}. All other 
operators of the Pauli group have expectation value zero, 
and therefore have no impact on the estimation of the fi- 
delity of a gate. 

All experimentally realized gates have been character- 
ized by calculation of their fidelity using Monte Carlo pro- 
cess certification (-Fmc)j unconstrained tomography data 



(-Ftom)j and tomography data constrained by maximum- 
likelihood estimation (Fml)- 

The CNOT gate, which changes the state of a target 
qubit if the control qubit is in the state |1), is described 
by a Choi matrix whose stabilizer group is generated by 
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M 3 
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This indicates that, e.g. eigenstates of the cr x ®t operator 
are mapped to eigenstates of the o x (g> a x operator by the 
CNOT operation. A visualization of the expectation value 
of the 16 Pauli operators with non-vanishing relevance 
distribution is shown in Fig. 1(a). For the present gate, 
the total number of different measurement settings is 120, 
since for each of the 15 non-unity Pauli operators we 
prepare 4 different input states and measure 2 different 
operators (required by the joint readout). In contrast, 
the total number of different measurement settings for 
process tomography is 4^ 2x2 ) = 256. 

The CPHASE gate, which changes the phase of the |1) 
state of the target qubit by 7r if the control qubit is in 
the state |1), has been characterized in a way similar to 
the CNOT gate as these gates are locally equivalent. 

A sequence of 2 CPHASE gates first acting on qubits 
1 and 2, and then on qubits 2 and 3 was characterized 
as an example of a 3-qubit gate with a stabilizer state 
Choi matrix. This Choi matrix has 4 3 = 64 Pauli op- 
erators with non-vanishing expectation value. For each 
of these operators we sample over 8 different eigenvectors 
by measuring 4 different operator combinations (required 
by the joint readout), in total 2016 different measurement 
settings, again without making use of random sampling. 
In contrast, process tomography for any three-qubit gate 
requires 4 2x3 = 4096 different measurement settings. 

Our implementation of the Toffoli gate [17] was also 
characterized by Monte Carlo process certification and 
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process tomography. The Choi matrix of the Toffoli gate 
is not a stabilizer state. Therefore, the list of relevant 
Pauli operators has no group structure and the relevance 
distribution Pr(i) is not uniform. We find that there are 
232 Pauli operators with non-zero expectation value of 1 
or ±0.5 out of 4096 possible ones. The total number of 
different relevant experimental settings is 231 x 8 x 4 — 
7392. 

Even without random sampling, the total number of 
measurements (including repeated measurements used 
for averaging) to achieve a smaller error is less for Monte 
Carlo process certification than for process tomography. 
For the Monte Carlo process estimation, we averaged 
each measurement setting ~ 330 000 times, resulting in 
a total number of ~ 2.4 10 9 measurements and an error 
of the fidelity of 0.5%, whereas for the process tomogra- 
phy we averaged each measurement setting for ~ 790 000 
times, resulting in a total number of ~ 3.2 10 9 measure- 
ments and an error of the fidelity of 3%. The measure- 
ment outcomes for the different operators are shown in 
Fig. 1(b). 

All resulting fidelities are summarized in Table I. Er- 
rors are stated as 90% confidence intervals. For Monte 
Carlo process estimation the error was calculated by 
Gaussian error propagation of the errors of the single 
measurements. For the error of the process tomogra- 
phy, the confidence interval of the distribution of fideli- 
ties was calculated based on a resampling of the measure- 
ment outcomes according to the inferred error statistics 
of the experiments. All the fidelities found with Monte 
Carlo process certification have tighter error bars than 
the fidelities obtained from process tomography. This is 
mainly due to the fact that the postprocessing for the 
Monte Carlo certification only consists of averaging the 
relevant measured values whereas full process tomogra- 
phy must impose collective physical constraints on the 
entire data set, and errors on the irrelevant observables 
can only add to the errors relating to the relevant observ- 
ables. 

As described earlier, the significant advantage of 
Monte Carlo process estimation is that one can estimate 
the fidelity of a process also without sampling over all 
relevant Pauli operators, on the expense of a higher un- 
certainty. If all relevant Pauli operators have been mea- 



Gate 


Fmc 


^tom 


-Fml 


CNOT 


81.7 ±2.1% 


80 ± 3% 


79 ± 3% 


CPHASE 


86.6 ± 3.0% 


86 ± 4% 


83 ± 4% 


2 CPHASES 


65.0 ± 0.8% 


67 ± 5% 


67 ± 5% 


Toffoli 


68.5 ± 0.5% 


70 ± 3% 


69 ± 3% 



TABLE I. Fidelities obtained by Monte Carlo process certi- 
fication (-Fmc) compared to the values obtained with process 
tomography (F toln ) and subsequent application of a maximum 
likelihood algorithm (Fml). 
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FIG. 2. Mean of the estimated average output fidelity of a 
Toffoli gate as a function of the number of sampled observ- 
ables. The error bars correspond to the 90% confidence inter- 
vals, which in turns gives an estimate of the additional error 
due to the non-exhaustive sampling of relevant observables. 
The inset gives the half-width of the 90% confidence intervals 
for the corresponding number of samples. 



sured like in our experiments, the only error in the fidelity 
is due to the experimental uncertainty in the estimation 
of the different expectation values. In the case that an 
incomplete set of Pauli operators is sampled, there is an 
additional error. An asymptotic bound for this error is 
calculated in the supplementary material of Ref. [9] , and 
it is shown that these bounds scale polynomially with 
the number of measured samples. However, the bounds 
are not tight and therefore too pessimistic to be used in 
the calculation of error bars. The error in the fidelity es- 
timate when performing non-exhaustive sampling of the 
Pauli operators can be obtained by non-parametric re- 
sampling methods such as bootstrapping [26]. However, 
given that we have measured all the relevant Pauli oper- 
ators for each of the gates we characterized, we can sim- 
ply gather statistics for estimates with non-exhaustive 
sampling. The corresponding data for the Toffoli gate is 
shown in Fig. 2. For our data one gets e. g. an additional 
error of 2% if one only samples 100 Pauli operators or an 
additional error of 3.2% for sampling only 50 Pauli oper- 
ators. This illustrates that Monte Carlo sampling leads 
to significant reduction in the numbers of measurements 
required to achive a given error bound on the fidelities. 

In conclusion we showed how Monte Carlo process cer- 
tification can be implemented experimentally in a sys- 
tem with three qubits and joint readout. This scheme is 
generic and readily applicable to any qubit system. We 
characterized the fidelity of two 2-qubit- and two 3-qubit 
gates. All estimates of the gate fidelity for each of the 
four gates are consistent, although Monte Carlo process 
certification gives more accurate estimates of the fidelity 
using fewer measurements. This shows that Monte Carlo 
process certification can be used as an independent proof 
of the fidelity. 

This work was supported by the Swiss National Science 
Foundation (SNF), the EU IP SOLID, and ETH Zurich. 
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In this supplemental material we summarize the exper- 
imental protocol that is used and give lists of all relevant 
operators that were used for the measurements described 
in the main letter. 



EXPERIMENTAL PROTOCOL 

The following recipe summarizes the experimental pro- 
tocol described in the letter: 

1. For a given ideal process £ calculate the Choi ma- 
trix PS ideal- 

2. Find Pauli operators Pi = Ai (g) Bi which have non- 
vanishing expectation values pi = tr/3f\ doal Pi =/= 0. 

3. For every Pauli operator Pi find the 
l a u)> \ a i 2 )i ■ ■ ■ > \ a id) (complex conjugates of 
the eigenvectors of Ai), and do the following: 

(a) Prepare the gate inputs in the state (a^). 

(b) Apply the process £ C xp to the state prepared 
in (a). 

(c) Measure the expectation Bi given the output 
of(b). 

(d) Compute the weighted average of the expec- 
tation of Bi over all the complex conjugates of 
the eigenstates, using the corresponding eigen- 
values as the weight. This gives an estimate 
of <n in the computation of the gate fidelity. 

4. Calculate the average of the estimated outcomes 
<7i weighted with the relevance distribution Pr(i) 
according to Eq. (3) of the main publication to get 
the fidelity. 



1 


1 


1 


1 


1 


Ox 


1 


Ox 


-fl 


Oy 


Oz 


Oy 


1 


O z 


O z 


Oz 


O x 


1 


O x 


Ox 


Ox 


Ox 


Ox 


1 


— Ox 


Oy 


Oy 


Oz 


— O x 


O z 


Oy 


Oy 


- °v 


1 


Oy 


Ox 


- Vy 


Ox 


Oy 


1 


- °y 


Oy 


O x 


O z 


- Oy 


Oz 


Ox 


Oy 


Oz 


1 


Oz 


1 


Oz 


<?x 


Oz 


Ox 


- o z 


Oy 


1 


Oy 


Oz 


Oz 


1 


Oz 



TABLE SI. All relevant Pauli operators for the verification 
of a CNOT gate. 



The relevant Pauli operators are the products of the 
elements of each subset of these generators. A complete 
list of the relevant operators is shown in Tab. SI. Each 
block of four operators corresponds to a row of the plot 
in Fig. 1 (a) of the main publication. 



RELEVANT OPERATORS FOR THE CPHASE 
GATE 



The stabilizer group that describes the Choi matrix of 
the CPHASE-gate has generators 



RELEVANT OPERATORS FOR THE CNOT 
GATE 

The stabilizer group that describes the Choi matrix of 
the CNOT-gate has generators 



Mi 
M 2 
M 3 
M 4 



a 



XI 



6- x 1 <x 

a z 1 <7 2 1, 

1 a x 1 a x , 

1 a z <7 Z <7 Z . 



(SI) 



Mi 
M 2 
M 3 
M 4 



a x 1 a x a z , 

a z 1 a z 1, 

1 a x a z b x , 

1 IT, 1 <7 Z . 



(S2) 



The relevant Pauli operators are found in the same way 
as for the CNOT gate and arc listed in Tab. S2. 
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1111 The relevant Pauli operators found from these genera- 

1 o x a, o x tors arc listed in Tab. S3. 
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TABLE S2. All relevant Pauli operators for the verification RELEVANT OPERATORS FOR THE TOFFOLI 

of a cphase gate. GATE 



RELEVANT OPERATORS FOR TWO 
SEQUENTIAL CPHASE GATES 

A sequence of two CPHASE-gates overlapping on the 
middle qubit has stabilizer group generators 



Mi 
M 2 
M 3 
M 4 
M 5 
M R 



a x 1 1 a x a z 1, 

a z 1 1 a z 1 1, 

1 o x 1 a z a x a Zl 

1 a z 1 t a z 1, 

t t a x t a z a x , 

1 1 a z 1 1 a z . 



(S3) 



Since the Choi matrix of the Toffoli gate is not a sta- 
bilizer state, the list of relevant Pauli operators has no 
group structure and the relevance distribution Pr(i) is 
not uniform. By calculating explicitly the expectation 
value for all 4096 possible Pauli operators, we find only 
232 which are non-zero. The corresponding operators are 
listed in Tabs. S4 and S5, labeld consistently with the 
measured values shown in Fig. 1(b) of the main letter. 
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TABLE S3. All relevant Pauli operators for the verification of two sequential CPHASE gates 
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TABLE S4. Elements 00000000 to 01111100 
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TABLE S5. Elements 10000000 to 11111100 



